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ABSTRACT 


Branch and bound and heuristic algorithms are 
proposed to minimise a quadratic bivalent function. 
Effective pruning methods are proposed. Extensive 
computational results are reported for both branch and 
bound and heuristic algorithms. 



' CHAPTER I 


INTRODUCTION 


1.1 Introduction s 

In this thesis quadratic bivalent programming problem 
of the following type is considered. 

Ps Minimize; 

f(X) = C^X + X^MX 

Subject to AX = b 

X e • ■ 

where C is a n x 1 real vector, M is a n x n real symmetric 

matrix, A is a ra x n matrix, b is n x 1 real vector and 

B 2 = {0, 1}. 

Several problems in graph theory, operations research, 
combinatorial mathematics, electrical engineering etc. can 
be formulated as problem P. Some such problems are; 
security investment in capital budgeting [12,14,15], faci- 
lity layout and location [2], computer aided layout design 
[ 13 ], arrangement in printed circuits, arrangement of printed 
circuits on the computer back plane, planning of presidential 
election campaign [I 6 ], scheduling parallel machines with 
change-over costs [4], portfolio selection [17] etc. 
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Although tile problem has such wide applications, no 
computationally efficient algorithms are known. It is well 
known that the problem is tTP-hard. 

Even if the objective function of P is assumed to 
be linear, the problem still remains difficult to solve. 

The essential difficulty pertains to the absence of 
necessary and sufficient optimality conditions for such 
problems. The solution procedures which have been reported 
in literature make use of the principles of exhaustive 
intelligent enumeration and relaxation etc. Such approa- 
ches usually require extremely large computational time 
even for small problems. 

Hammer and Pkideanu [7] have proved the following 
results for the problem 

HI; Minimize; 

f(X) 

Subject to f .(X) = 0, j = 1,2,..., m 

J ‘ 

where each of f^(X) is an integer valued pseudo-boolean 
positive function i.e. >0 for X e 62 ^ and f(X) is 

a polynomial function. 

-H* "if 

i) If the vector X = (x^, X 2 , ...» x^) is a solution 
to the problem Kl, then also minimizes the pseudo- 
boolean function 

. m 

F(X) = f(X) + (S'^ - S” + 1) E f.(X) (1.1.1) 

j=l ^ 
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where and S'” are the sum of positive and negative 
coefficients of f respectively. 

ii) If X* minimizes F and 

F(X*) < S'*" 

then X^' is a solution to the problem HI. 

iii) If X minimizes F and 

F(X*) > 


then the constraints of the problem HI are inconsistent. 


If any of the constraints f-(X) for q = 1,2, .,.,m 
is not a positive function, then we replace the constraint 
= 0 by (fj(X))^ = 0. Since the function ( X) ) ^ 

is a positive function, we can use equation (1.1.1) to 
eliminate the constraints. 


Moreover, any integer valued inequality constraints 
of the type 2l ^ converted to an equivalent 

equality constraint as given below; 


f.(X) - I 2*^ y 
k=0 


— • — y u 

boxmd on f .(X), 


0 

where is an upper 


Using the above results, any quadratic bivalent 
programming problem with linear constraints can be converted 
to equivalent unconstrained quadratic bivalent programming 
problem. Hence problem P can be converted to equivalent 
unconstrained quadratic bivalent programming problem. 
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In view of Hammer and Rudeanu' s result given above, 
we consider the following problem for developing the 
solution procedure, which can be used to solve P also. 

PI t Minimize s 

f(X) = + X^RX (1.1.2) 

Subject to X e 

where D is a n x 1 real vector, R is a n x n real symmetric 
matrix. 

2 

Since x^^ = x^^ for x^ = 0, 1 linear terms in the 
objective function of (1,1.2) can be implicitly taken into 
quadratic part. Hence problem PI can be v/ritten as, 

P2: Minimizes 

f(X) = X OX 
Subject to X e 

where Q is a n x n real symmetric matrix. 

Rosenberg [22] has shown that any unconstrained 
polynomial bivalent program minimize f(X) subject to 
X e B 2 is equivalent to an unconstrained quadratic 
bivalent program. 

The existing solution procedures for the problem P 
are mainly of three kinds: i) Boolean approach, ii) Branch 
and Bound methods and iii) Network approach. The Boolean 
approach was suggested by Hammer and Rudeanu [7]. This 
approach does not seem to be very suitable for confutation 
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on computer. Branch and bound methods are discussed by 
Hammer and other authors in [3» 8, 9, 10, 23, 24]. 

Hammer and Peled [9] observed that it takes 110 sec. 
(including input/output time) on IBM 360/50 to solve 20 
variable polynomial programming problems vd.th 50 terms in 
the polynomial. They further state that 30 variable 
polynomial problems with 70 terms in polynomial could not 
be solved due to memory limitation. 

A number of unconstrained quadratic bivalent 
programs can be solved by network flow algorithms. Study 
of this class of problems is done by Picard and Ratliff 
[ 18-20]. But this approach has certain restrictions. 

For example to use algorithm given in [l8] for problem P2 
all the off-diagonal elements of matrix Q are required to 
be positive. 

Methods based on implicit enumeratj.on. include the 
one given by Laughhun[l4], Taha [25, 26 ] has given an 
algorithm for bivalent polynomial programming problems 
based on Balas [l] additive algorithm. 

Recently Gulati [5] proposed a branch and pruning 
algorithm to solve unconstrained quadratic bivalent 
programming problems. Using this algorithm, problems 
involving 125 variables could be solved within 198 seconds 
on DEC - 10 system. 
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From the above discussion, it is clear that no com- 
putationally efficient algorithm is kno\'m to solve P2. 

In this thesis, we have made an attempt to develope 
a computationally attractive algorithm to solve P2. 

1.2 Solution Approach g 

A branch and bound method is developed to solve P2. 
Bounding strategies are developed that are found to be 
effective. In addition, Gulati’s [5] pruning test is used 
which ensures that there does not exist a local solution 
along a particular branch. 

Branch and bound method is essentially used to 

identify the most difficult problems and to test the effec 

tiveness of heuristics. To solve difficult and/or large 

size problems heuristics are developed. 

/ 

In Chapter II, we discuss in detail the solution 
procedure. ¥e discuss some heuristics in Chapter III. 
Chapter IV deals with computational results pertaining to 
the effectiveness of the algorithms proposed in this 
thesis. 



CHAPTER II 


BRANCH AND BOUND METHOD 


In this chapter, we first develope certain mathema- 
tical relationships which are used in the proposed branch 
and bound method. The method is then described. 


2.1 Neighbouring Point i 

Now we define neighbouring point. 

Definition 2.1.1 

For any given X = (x^, x^, ^+l^***»^n^* 

we define, 

X = (^2^, . • . , ^k+1^ • * • » ^n^ (2.1.1) 

as a neighbouring point of X for k = 1,2,..., n. 

Now we develope certain mathematical relationships 
useful in the proposed method. 


2 . 2 Mathematical Relationships s 

For any given point X e '^^9 
let I^(X) = (ilx. =0} 

I2(X) = (ilx^ = 1}. 

Given any point X e and the objective function 
value f(X), the objective function value f(X^) corresponding 
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to a neighbouring point of for h “ n can 

be found as. 


f(X^) 


f(x) + qj^ 
f(X) - 


+ 2 


iel^(X) 


^ik 


+ 2 Z 

ieI^(X)-{k} 

if k e I^(X) 


if k e Iq(X) 

( 2 . 2 . 1 ) 

( 2 . 2 . 2 ) 


By combining equations (2.2.1) and (2.2.2), we can write, 

f(X^) = f(X) + QDIAGj^(X) for k = l,2,...,n (2.2.3) 

where QDIAGj^(X) is the k-th element of 1 x n size array 
COIAG (X) corresponding to point X and defined as, 


ODIAG, (X) = 




if k e I^(X) 


(2.2.4) 


(2.2.5) 


In theorem (2.1), we obtain tlie elements of 
QDIAG (X^) corresponding to a neighbouring point X?^ of X 
for k = 1,2,;.., n, in terms of QDIAG (X) . 


Theorem 2.1; 


Given X = (x^, ..., x^) e 

for i = 1,2,,,,, n and k = 1,2,..., n 

“-aDlAG^(X) if i = k 


ODIAG^(X^) = 


( 2 . 2 . 6 ) 


QDJAGj;(X) + if x^ = and i k 

(2.2.7) 

QDIAG^. (X) - if x^: / x^^ and i k 

( 2 . 2 . 8 ) 


k 



y 


Proofs 

Case 1 ; If k e I^Cx) then k e (X*') 
Also, 


IqCX^) = 

'vk 


= I^(X) U {k} 

i) If i = 1: then i e I^(X), is I-,(X^) and 

aDIAG,(X^) = -[q,, +2 51 q ] 

(by (2 

= - [q . ,• + 2 S q^ ^ ] 

DeI^(X)u{k}~{i} 


Since i = k, 


aDIAG,(X) = Uii + 2 2, , q„] 

^ 3el]_(30 ^2 


Therefore, 


(by (2 


QDIAC-(X^^) = ~QDIAG^(X). 
ii) If = Xy. and i k then 

i e Iq(X), i e Iq(X^) and 


ODIAG.CX^) = q,, +2 I q,, (by (2 


= q. . + 2 X q. . 

3 eI^(X)Uk 


^ jel^CX) 


Since i e Iq(X) 


aDlAG^(X) 


Gq-i + 2 2 q. . 

jel. (X) 


(by (2 


.2.5)) 


.2.4)) 


.2,4)) 


* 2 * 4 )) 



Therefore, 


QDIAG^(X^) = ODIAG^CX) + 2q_^^, 
iii) If ^ and i k then 
i e l 3 _(X), i e I^(X^) and 


aDIAO.(}^') = - [q + 2 S , q ] (by (2 

== — [q . - 4* 2 E Q • • 1 

OeI^(x)U{k}-{i} 


- + 2 ^13 


S ‘Inn + 2q^k^ 


Since i e I-j_(X) 


aDIAG^.(X) = - [q,, +2 S 

Therefore, 


1'"' ‘-'^ii ' *“ \ f •> ‘^ni^ 

deIi(X)-{i} 


ODIAGj: (X*') = QljlJlGj_ (X) - 2q^j^ 


Case 2 ; If k e I^^CX) 
/aso, = 

i^Cx^) = 
1) If i = k then 
<aDIAG^(X^) = 


then k e I^(X^) . 

Iq(X) U {k} 

Il(X) - {k} 

i e I^(X), i e Iq(X^) and 


^ ^ 0£ln(X^) 


.2.5)) 


2.5)) • 


(by (2.2.4)) 



Since i = k, 


ODIAG.CX) = -[q.. +2 ("by (2.2.5)) 

^ 3eIi(X)-{k} 

Therefore, 

aDIx\G^(X^) = - aDIAGj_(X) 

ii) If i k and = x^ then 

i e I3_(X), i e l3_(X^) and 

QDIAG.(X^) = - [q . +2 , , , q.J (by(2.2.5)) 

= -[q,-,- +2 £ q,-^] 

jEl. (X)-{k}-{i} 


= — [q. • + 2 £ 

del3^(X)-{i} 


'lij] + 2qii^ 


Since i e I-j_(X) 


aOIAO^CX) = (M2.2.5)) 


Therefore, 


aDIAG^(X^) 


QDIAG^(X) + 2q,- 


ik 


iii) If i k and x. ^ x, then 

1 x\ 

i e I^(X), i E I (X^) and 


■ U„ . a ,„1 


(by(2.2.4)) 
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Since i e Iq(X), 

aDIAG.(X) = [q,-. + 2 Z q. .] (by (2.2.4)) 

^ Oel^^ (X) 

Therefore, 

aDIAG^(X^) = aDIAG^(X) - 2qj_j^ 

This completes the proof. 

2.3 Local liinimization ; 

In this section we introduce the concept of locally 
minimizing point of P2. 

2.3.1 Locally Minimizing Points 

Definition 2.3.1 8 X e is said to be a locally minimizijog 
point of P2 if, 

f(X) < f(X^) for k = 1,2,..., n 
■vheve X^ is defined in (2.1.1). 

Theorem 2.2 s 

X e B 2 ^ is a locally minimizing point of P2 if and 
only if, 

ODIAG (X) > 0 (2.3.1) 

Proof* 

From (2.2.3), we have, 

f(X^) = f(X) + aDIAGj^(X) for k = 1,2,..., n (2.3.2) 

Let X e be a locally minimizing point of P2, then 
f(X) < f(X^) for k = 1,2,..., n. 
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From (2.3.2), we get, 

QDIAGj^(X) >0 for k = 1, 2, . . . , n. 

Hence X, a locally minimizing point satisfies (2.3.1). 

Conversely, let X e satisfy (2.3.l)s. then from 
(2.3.2) , we get, 

f(X^) > f(X) k = 1,2, ..., n 
which shows that X is a locally minimizing point of P2. 

This completes the proof. 

We now present an algorithm to determine a locally 
minimizing point of P2. ¥e start with a point X e 

2.3.2 /ilgorithm 2.1 s LOCAL 

Step 1 ? Select an initial point X e and compute, 
aDIAG^(X), i = 1,2, ..., n, f(X) 

GiDIAG (X) >_ 0 go to Step 4 else choose k 
according to one of the rules specified below and 
go to Step 3. 

Step. 3 s Compute f(X^) = f(X) + QDIAGj^(X). Compute 

1 = 1,2,..., n by using equations 
(2.2.6) to (2.2.8). Update X to X^. Go to 
Step 2. 

Stej^Ji.? Stop, X is a locally minimizing point of P2 and f(x) 
is the value of the objective function at this point. 
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2.3.3 Rales for Selecting k in Step 2 of Algorlthm.LOCi^ ; 

Rule 1 1 Select the smallest k such that QDIAGj^(X) < 0. 

Rule 2 s Select the k such that 

QDIAG, (X) = min [QDIaG.(X)] i = 1,2,..., n 

i 

Rule 3 s (LRC Rule) i Let the indices of QiDIAG (X) be arranged 
in circular fashion. Following a fixed direction, 
choose that k which is nearer to the index tliat was 
choosen in previous step and GiDIAGj^(X) < 0. 

The justification for the algorithm 2.1 can be argued 
as follows? 

We start with the point X (x^, X2, . . . , x^^) e 
and at each iteration the objective function value decreases. 
¥e stop at a point which satisfies the necessary and suffi- 
cient conditions for a point to be locally minimizing as 
given in theorem 2.2, Since the objective function value 
decreases at every iteration and the number of points 
available is finite, the algorithm terminates in a finite 
number of iterations. 

2.4 Global Minimization ; 

» 

In this section, we discuss the pruning tests, and 
also the branch and bound method to solve P2. 

2.4.1 Pruning Test s 

This is same as the pruning test used by Gulati, 

Mittal and Gupta [6], Now we briefly explain the test. 
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Let {U^, U^, U^} be any partition of {l,2, n} 
where, = {iji is fixed and i e Iq(x)} 

U-, = (i li is fixed and i e I^(X)} 

= {iji is free } 

If we fix x^ = 0 for i e U^, x^ = 1 for i e Uj^,then 
the pruning test gives sufficient conditions under which there 
does 'not exist an assignment of values of the free variables 
x^, i e U^, such that the corresponding completion 
(x^, x^f x^) is a local minimum of P2. 

If x^, i e U^, is any assignment of the free variables, 
then the corresponding completion X = (x^, X 2 , ...» x^) e 
where x^ « 0 for i e and x^^ = 1 for i e U^. For a fixed 
assignment x? for i e U^, of the free variables, let X° 
be the corresponding completion, and for s e U let, 

= {1 e Uj 1 > 0 } n (X°) 

A, = {1 s Uj I q^^ < 0 } n (X°) 

Aj = {1 e Uj I q^^ > 0 } n Ij, (X°) 

A^ = {i e I q^^ < 0 } n (X°) 

Theorem 2*3 t If ODIAG^ (X°) < 0 for some s e U^, such "that 

^ . 2qgi * . ^ , 2|qsil ^ (X°)| (2.4.1) 

1 s i £ i\.2 

then there does not exist any assignment of free variables 
for 'v^ich the completion is a local minimum of P2. 


Proof is given in [6], 
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Theorem 2.4 i 

If QDIaG (X°) < 0 for some s e U , such that 
s o 

i: 2q . + 12 Iq -1 < 1 ODIAG (X°) | (2.4.2) 

1 e i e ® 

then there does not exist any assignment of the free 
variables for which the completion is a local minimum of 
P2. 

Proof is given in [6]. 

2.4.2 Lower Bound ? 

In this section, we develope an effective lower 
bound for problem P2. 


Gallo, Hammer and Simeone [3] stated that if V. is a 

m ^ 

lower bound for min {q.-^ X s X e S}, where q.. is the i-th 

u d 

column of G, and S is constraints set, then the function 

^ n 

2 V. X. is obviously a lower plane for f(X) « I (q.'-^X)x. 


d=l 




in S. Using this result, we develope a lower bound for 
problem P2 as given below. 


Let Vq 


I 




2 


X q. ^ + min { 
le\5^ 


£ 

ieU^ 


for d e 


Then lower bound for P2 can be written as, 
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LB = + min { t V. x. s x. e Bp} 


.i e Uf 


D 3 


= V + B min [O, V.] 

° 3 e ^ 

"When V. < 0, if X. is allowed to take 1, then q. . will he 

added to objective function irrespective of the sign of 

q... Hence V. is modified to, 

33 3 

V' = q.. + 2 B q . + B min [0, q_], 

^ ieU^ ieU^-{j} 


for j e (2.4.5) 


If free variable x. has value zero, then, 

J 


v' = QDIAG- (X) + B min [O, q_. ^],3 e Uf 
^ ^ ieU^-{o} 

in view of (2.2.4) 

Therefore, 

LB » -f. B min [O, vl ] (2.4.4) 

° 3 e Uf 5 

Since the effectiveness of our bound is dependent on 
the sum of negative elements of the sub matrix corresponding 
to free variables, it will be benificial to rearrange the 
elements of matrix Q such that the sums, 

n 

q. . + 2 B min [O, q. .] for i = 1,2,..., n (2.4,5) 

11 . T IJ 


are in ascending order. 
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2.4.3 Trivial Test ? 

Now we give certain equations that may help us in 

reducing the size of matrix Q. 

For any i = 1,2,,.., n, if < 0 and 

n 

q . , +21 max [O, q. .] ^0 (2.4.6) 

0=1 

then x^ will take value 1 in any optimal solution. Then we 
modify the diagnol elements of Q as, 

^dd ' ^dd ^ 2^id » ^ ^ 

d ^ i> 

for i that satisfied (2.4.6) and delete colximn and row of 
Q corresponding to x^. 

Similarly for any i = 1,2,..., n, 

if q^j_ > 0 and 

n 

qfi + 2 Z rain [O, q^^] >0 (2.4.7) 

then x^ will take value 0 in any optimal solution. Then, we 
delete column and row of Q corresponding to x^. 

By repeatedly using equations (2.4.6) and (2.4.7) 
and making necessary modifications to Q, it may be 
possible to reduce size of matrix Q. 



19 


2.4.4 Branch and Bound Method s 

The proposed method is essentiallv a depth first 
search method. We Identify any node by the point 
X = X2, ...» and the level upto which the 

variables are fixed. 

Branching Strategy ? Branching variables are selected in 
ascending order of their indices. The branch having the 
value of branching variable equal to zero is explored 
first. 

Type of Node s At any node the completion X is found by 
setting free variables at zero value. We identify the 
node as type I if the completion is a locally minimizing 
point for P2, otherwise as type II. It can be observed 
that the type of successor node obtained by fixing the 
free variable at zero value is same as that of parent 
node. 

Bounding Test ? At any node we calculate the lower bound 
using (2.4.4) and if lower bound ^ incumbent 
we prune that branch. 

Pruning Strategy ; At any node pruning is done using bound- 
ing test only if the type of node is I, othei*wise we use 
both bounding test and pruning test. 

A formal description of the algorithm to generate 
the global solution is given below. 
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Algorithm 2.2 GLOBAL i 

Step I s Initialize level = 0 , go to step 2. 

Step 2 s Use algorithm LOC/iL to find a local solution X, 
Set the optimal solution X* as X and f(X*^) as 
f(X). Set incumbent as f(X ). Also set 
X = {0,0,0,... 0}, f(x) = 0, Calculate QDIAG(X). 

Step 3 s Set level = level + 1, go to Step 4. 

Step 4 s If level equals to number of variables go to 

Step 8 else go to Step 5. 

Step 3 s Apply bounding test. If bounding test succeeds 
go to Step 8 else go to Step 6. 

Step 6 s If type of node is I, go to Step 3, else go to 
Step 7. 

Step 7 s Apply pruning test. If test fails, go to Step 3» 
else go to Step 3. 

Ste £_^5 If = 1, go to Step 9, else set 

calculate X, QDIAG (X), f (X) , Update X*, f(x"), 
incumbent, go to Step 4. 

Step . 9 s If level equals to 1, go to Step 10, else 

set ~ Calculate X, ODI-iG (X), f(X), 

Set level = level - 1, go to Step 8, 

Step 10s Stop. X**" = {x^, X*, ..., is the optimal 

solution. f(X ) is the objective function value. 
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Ill ustr ation ; 

Following numerical example illustrates the proposed 
method for n = 5 (Algorithm GLOB/iL) . 


-29 

0 

15 

15 

1 

0 

-68 

19 

15 

17 

15 

19 

-112 

6 

17 

'15 

15 

6 

0 

7 

1 

17 

17 

7 

-56 


Using algorithm 2.1 (LOCa'JL) with starting point X » (0,0, ...,0) 
we get the first locally minimizing point as x^^ = 0, X2 = 1, 
x^ =1, = 0, x^ = 0, Value of the objective function is 

“142. So incxombent INC = -142 for branch and bound method. 

And the values of QDIAG corresponding to this point are 
(1, 30, 74, 42, 12). 

For branch and bound method, we start v^ith point 
X = (0, 0, 0, 0, 0). First we fix x^ at 0. Lower bound is 
found to be equal to -236. Type of node is II, Both 
pruning and bounding tests fail. 

We now fix Xg at 0. Lower bound is equal to -168. 

Type of node is II. /igain both the tests fail. ¥e now 
fix x^ at 0. Lower bound is equal to -56, Since lower 
bound > INC, we prune this branch and search along x^ = 1. 
With x^ = 1 type of node is II. Lower bound is -134 > INC. 

So we prune this branch also. 
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Now we trace back and fix X2 !• Now lower 
bound is equal to -164. Type of node is II. Both the 
tests fail. When we fix x^ at 0 lower bound is equal to 
-90. Since lower bound > INC, we prune this branch. Now 
we fix x^ at 1. Lower bound is equal to -142. Since 
lower bound = INC, we prune this branch also. 


Now again, we trace back and fix x^ at 1, Bounding 
test succeeds with X2 = 0, = Oj Xp = 0, x^ = It Xp = 1» 
x^ = 0 and X2 = 1, x^ = 1, 


We stop at this stage. Optimal solution is 
(0, 1, 1, 0, 0) and optimal value of the objective function 
is -142. 


Complete description of algorithm is shown in 
Fig. (2.1). 











ch;.pter III 


HEURISTICS 


3.1 Introduction ? 

In this chapter, we discuss the heuristics that can 
be used to s-:?lve large size problems within reasonable 
amount of time. Heuristics provide near~optimal solutions 
in general. 

All the heuristics that we discuss in this chapter 
essentially consist of finding a local solution or a set 
of local solutions. ¥e pick-up the best among the set of 
local solutions. These heuristics differ from each other 
in identifying the starting points for algorithm LOCAL. Once 
the starting point is identified, we use algorithm LOCi\L 
to find local solution. This study also helps us in 
finding out starting point strategy to be used in algorithm 
LOC/\L to find 'initial incumbent to branch and bound method. 

We now give different strategies for identifying 
starting points and use them as heuristics to solve problem P2, 

3*1.1 Starting Point Strategies ; 

3*1*1*1 All 0 ' s ? In this method, we set starting point as 
X = {0, 0, 0} and then use algorithm LOCAL to find 


local solution 
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5«1.1.2 All 1 ‘ s £ Here we set the starting point as 
X = {l, 1, 1} and use algorithm LOC^Hj to find local 

solution. 


3.1.1. 3 Random Start i Similar methods are used to solve 
Quadratic assignment problems [2l]. This method essentially 
consists of randomly generating set of K starting points 
and then finding the local solution for each of these 
starting points. We prefix the cardinality of I's in 
the starting point and then select the variables to take 
value 1 using uniform random nuiabers. We hope that this 
ensures better coverage of local solutions. For our 
computational study we will prefix the cardinality of I's 
as (.In, ,2n, .3n, ..., ,9n) and hence the value of K = 9. 


3. 1.1. 4 Constructive Method ; 

This method is similar to random start method except 
that in each of the starting point that wo generate, we allow 


a particular set of variables to take 1* s and the rest zero. 
As mentioned in Chapter II, if the elements of matrix Q are 
rearranged such that the sums, 

n 


IjLi + 2 E min (0, q ), 
0=1 


1 = 1, 2, . * . , n 


are in ascending order, then we es^pect that the chance of 
a variable taking one go down with increase in index. 

So we fix first few elements of X at 1. Mjmber of variables 
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to take one is equal to the cardinality of I's. For 
computational study, vre prefix the cardinality of l' s 
as (.In, .2n, ..., .9n). We use algorithm LOCxIL to find 
local solution for each of the starting points and we 
pick up the best among these local solutions, 

3.1.1. 5 Epsilon Methods 


In this method, we construct a starting point by 
relaxing equations (2,4.6) and (2.4,7) as given below. 

For any i = 1,2,..,, n 


if q^^ < 0, and 


n 


if 


q... + e x2 1 max (0, q. .) < 0 set x. = 1 

-i- J- * T 1 J 1 


else set x. = 0 


if qj^j_ ^ 0, and 


n 


if q^^ + e X 2 min (O, q^. ^) ^0 set x^. 
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else set x^^ = 1 


Here e is to be judiciously prescribed. We use algorithm 
/ 

'2,1 to find the local solution. 



CHi\PTER IV 


COMPUT.iTIOINLU. RESULTS AND CONCLUSIONS 

^ 1 Introduction i 

In this chapter, we shall discuss computational 
performance of the algorithms developed in the previous 
chapters. Computations have been performed on DEC 10 
(KL 40 processor). Programs are coded in FORTRilN 10 
(DEC version) . Actual run time is taken to be the compu- 
tational time. 

For the test problems, the elements of matrix Q. 
are generated using uniformly distributed random numbers, 
such that the matrix 0 is symmetric and the elements of Q 
are integers. Two types of problems are considered i.e. 
l) Problems with only on-diagnol elements of matrix Q being 
negative, 2) Problems with negative elements distributed 
throughout the matrix Q. 

VTe hypothesize that the computational performance 
of the algori-tdims is dependent on the following factors? 

i) Density of matrix Q. 

ii) Ratio of size of on-diagonal elements to that of 
off-diagonal elements of Q denoted as I. 
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iii) Percontr>(te of negative elements in total non-zero 
elements of matrix Q, denoted as IN. (Applicable 
onl^^ for the problems v;ith negative elements 
distributed throughout the matrix Q). 

The elements q . ^ 1 G of the matrix Q are generated 
from a uniform probability distribution U [C, 100] for all 
problems. The diagonal elements are generated by multipli- 
cation of n[-100, O] and I for problems with only on-diagonal 
elements negative and by multiplication of U[0, lOO] and I 
for problems with negative elements distributed -ttiroughout 
matrix Q. A random number is generated to control the 
density of the matrix Q. For problems with negative elements 
distributed throughout Q, a ratio of negative to non-zero 
elements is prefixed and the sign of the specific element 
is generated using uniform random number. 

After generating matrix Q, we apply trivial test 
to assign variable value 1 or 0 as discussed in Section 2,4*3 
and reduce the problem accordingly, if possible. Then we 
rearrange the matrix Q such that the sums given in (2.4.5) 
are in ascending order. 

4,2 Computational Study and Results i 

4,2.1 Computational Evaluation of Rules to Select the 
Variables in Alf.-:orithm LOC AL; 

We evaluate the following rules for 
selecting variable in step 2 of algorithm LOC/jL (Sec, 2.3.2) 
outlined in Sec, 2,3.3, 



29 


i) llule 1: Selecting the highest negative element of 

QOIAG . 

ii) r-iulo 2 s Selecting the first negative element of 

ODIAG. 

iii) Rulc- 3s LRC rule. 

Performance is evaluated using the following 
criteria. 

i) Number of problems, for \>tiich the objective fimction 
value obtained, by using a particular rule is better than or 
atleast as good as the remaining two rules. 

ii) Number of iterations required to find a local solu- 
tion v/hen a particular rule is used. 

The stud3^ is carried out on problems with negative 
olcraonts distributed throughout matrix Q. Problems of size 
n - 20 and n =* 30 are considered. For each value of n, 

30 problems are solved by varying density (.25, .50, 1.0), 

I (1, 3, 5, 7, 9) and IN (30, 50). 

Results of this study are reported in Table 4.2.1. 

It is observed that the lule 1 that chooses the variable 
element of 

with highest negative/ QDI AG dominates the other two rules 

in both the criteria. 

Computational Eval u ation o f Different Starting Point 
S tl^ategies Used jn^lgoriWin^LO C/iLs 

We evaluate the following strategies used for identi- 
fying the starting points in algorithm LOCiVL (Sec. 2.3.2) 
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outlined in Sec. 3.1.1. 

SI; All O's 
S25 All I's 

S3s Random starts In this method we consider generation 
of random starting points with cardinality of I's in 
X prefixed at (.In, .2n, .9n) and hence K = 9 as 
outlined in Sec. 3. 1.1. 3. 

S4s Constructive method; In this method also we prefix 

the- cardinality as given above and variables to take 
1 are decided as outlined in Sec, 3.1. 1.4. 

S5s Epsilon Methods Extensive computations have been 
performed by varying the value of the parameter 
e (Sec. 3. 1.1. 5) and at e » 0,2 the results are found 
to be encouraging. Hence we fix e = 0.2 for computa- 
tional study . 

Performance is evaluated using the following criteria. 

1. Number of problems for which the objective function 
value obtained by using particular strategy is better than 
or at least as good as the remaining strategies. 

2. Number of problems for which the objective function 
value for a specific strategy is within 10 percent of the 
best solution. 

3. Maximum error with respect to best solution, where 


error is defined as; 
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If ft; is the objective fuinction value obtained by 

strategy S^, then 
J 


percentage error 
for strategy 


(min f„ • 
i ^i 
min 
i 



) X 100 


Strategies are tested on problems 1) with only on- 
diagonal elements of matrix Q negative, 2) v/ith negative 
elements distributed throughout matrix Q. In both the cases 
problems with number of variables n = 50 and 100 are consi- 
dered. Other input parameters are varied as follows: 

Density (O.l, 0,25, 0,50), I (l, n x density/2, n x density) 
and IN (30, 50, 70). For each value of n, 27 problems are 
solved, 

iiesults are reported in Table 4.2.2. 

It is observed that the random start strategy domi- 
nates all other strategies ifi both the criteria. 

Further to study the relationship of the cardinality of 1 
of random starting solution with respect to the best local 
solution, the following problem is considered. 

number of variables n = 100 

Density of matrix Q = 0,1 

Percentage of negatives = 50 

Number of problems solved = 


20 
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Cardinality of starting point is varied as 
(.05n, .In, .95n). It is observed that 75 percent 

of the best local solutions are covered by the starting 
points with cardinality greater than ,5n. So for large 
size problems, it may be worth to use more random starting 
points with higher cardinality of I’s. 

Mow, we suggest the following heuristic to solve 
large size problems* 

H euristic BEST LOCj\L s 

i) Select K random start points with cardinality of 1' s 
being prefixed. 

ii) For each of the starting points, get a local solution 
using algorithm LOCAL. 

iii) Select the best local solution. 

4.2.3 Computational Evaluation of Branch and Bound (GLOBAL) 
and Heuristic BEST LOCAL S 

We evaluate the effectiveness of heuristic in terns 
of the computational time reqd, and the average percentage 
error. 

Percentage error is calculated as given below; 

Percentage error 

(Optimal solution value - heuristic solution value) 

= X IOC 

Optimal solution value 



We also identify the most difficult problems to 


solve. 

Study is carried out on two types of problems: 

i) Only on diagonal elements of Q are negative; We 
solve 5 problems for each of the following combi- 
nations , 

n (25, 30), Density (0.25, 0.50, 0.75, 1.00), 

I (1, 3, 5, ..., 19) 

For n = 50 and density =0.75, 1, in addition to the 
above combinations we solve problems with 
I = (21, 23, 29) also. 

Results are shown in Tables (4.2.3) to (4,2.7). 

ii) Negative elements of Q are distributed throughout the 
matrix: 

We solve 5 problems for each of the following combi- 
nations. 

n (25, 30), Density (0.25, 0.5, 0.75, 1.00), 

I (1, 6, 11) and IN (10, 30,50, 70). 

Results arc reported in Tables (4.2.8) to (4.2.11). 

Fig. 4.1 shovj^s the computational time requirements 
for different values of I and density for problems with 
number of variables » 25 and with only on diagonal elements 
negative . 

We make the following obseirvations from the results 
shown in Tables (4,2.3) to (4.2.11) and Fig. 4.1. 
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i) llie computr.tional time required for heuristic algo- 
rithm (BEST LOCiVL) is approximately constant for 

a given n irrespective of the factors I, IN, Density. 
This excludes tho cases where the problem size can 
be reduced with trivial test considerably. 

ii) Range of average percentage error is (O, 2.81) . 

Prom Tables (4.2.3)to (4.2.6) and Fig. 4.1, 'vre meJee 
the following observvations for the problems with only on 
diagonal elements of Q negative. 

i) Computational time for branch and bound method 

increases with increase in value of I and then starts 
decreasing. The maximum is reached for values of I 
approximately equal to 

0.75 X (n X density) 

This may be due to the fact that the effectiveness of 
bounding test and pruning test is dependent on the negative 
elements of QDIAG corresponding to free variables. As the 
value of I increases the sum of nega-tivo elements of 
QDIAG corresponding to free variables also increases, hence 
bounding test becomes less effective for' higher values of I. 
But, for higher values of I, since the on diagonal elements 
of Q and hence QDIAG are large, the trivial test and pruning 
test become more effective. For intermediate value of I, tests 
are not very effective. 
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ii) For low values of I computational time for brtanch 

and bound method decreases with increase in density 
and for high value of I the time increases v^ith 
increase in density. 

This may be due to the fact that the effectiveness 
of bounding tost and pruning test is de-pendent on density of .Q 
and value of I as given belows 

For higher values of density when we fix a variable 
at 1, large number of positive elements wall get added to 
QDIAG. Hence the sum of the negative elements of GDI AG 
decreases with increase in density. Hence the bounding 
test becomes more effective with increase in density of Q. 

Since the sum of positive oleraents in a row of Q 
corresponding to free variables increases with increase in 
density of Q,the pruning test becomes less effective with 
increase in density of Q. 

Also since the bounding test is more effective for 
low values of I, we expect the computational time required 
to decrease with increase in density for low values of I. 
Similarly, since the pruning test is more effective for 
high values of I, we expect the computational time to increase 
with increase in density for high values of I. 

From Tables (4.2,8) to (4.2.11) we make the following 
observations for the problems with negative elements distri- 
buted throughout Q. 
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i) Computational time for branch and bound method 
increases v/ith increase in density of matrix Q. 

This is because, the sum of positive and, negative 
elements of Q corresponding to free variables increases 
with increase in density of matrix Q, hence both pruning and 
bounding tests become lees effective with increase in 
density. 

ii) Computational time for branch and bound is low for 
low and high values of percentage of negative 
elements in Q. 

This may be, due to the fact that the trivial test 
is effoctivo for low and high percentage of negative elements. 
Also bounding test is effective for low percentage of nega- 
tive s. 

iii) Computational time for branch and bound decreases 
with increase in I. 

This may be due to the fact that the trivial 
testis raoreeffective for higher values of I. 

4. 2.3.1 Difficult Problems s 

From the above observations we conclude that degree 
of computational difficulty with respect to branch and 
bound for the following problems is maximum, 

i) For problems with only on diagonal elements of Q 
negative J 
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Problems with densit^r cf matrix Q = 100 percent 

Value of 1 =1 (JULjf.nsiiX.) (approximately) 

ii) For problems with negative elements distributed 
throughout Qs 

ProblviHis with density of matrix Q = 100 percent 

Value of I =1 

Percentage of negatives IN = 50 . 

4.2,3*? Performance of Branch and Bound and Heuristic 
BEST LOCAL* on Larg'e'^Size ProBlems s 

Table (4.2..7) shows the performance of branch and 
bound algorithm and heuristic BEST L0C.4L for large size 
problems. We are able tc solve 170 variable problems in 
about 62,13 seconds of run time by branch and bound algorithm. 
Heuristic BEST LOCAL solved the same problems in about 
4,12 sec. ftirther, it is observed tliat as the problem size 
increases the heuristic solutions are deviating more from 
the optimal solution, although average error is within 
10 percent of the optimal value. 

Our branch and bound algorithm performs better than 
Gulati's[5] branch and pruning algorithm. For similar size 
problems the time with our algorithm is l/4th to 1/5 th of the tim( 
taken by Gulati's algorithm. 


38 


Table 4.2.1 

Comparison of rules for selecting variable in algorithm 

LOCAL 

Lis Select the highest negative element of (5DIAG 
L2s Select the first negative element of QDIAG 
LRC Rule 


Mimber of problems solved for each n = ^0 


Rule 


Mum'S er of variable n 



20 

30 


A 

B 

A 

B 


LI 

20 


17 


5‘0 

L2 

18 

5*\ 

15 


75 

L3 

14 

136 

13 

A 

7-0 


• Entries in Column A show the number of problems, 

for vihich the objective function value obtained by 
using a particular rule is better tiian or atleast as 
good as the remaining two rules. 

Entries in Column B show the t©4al number of 
iterations required to find local solution, viien a 
particular rule is used. 


Comparison between different starting point strategies 
SI: All O^s, S2: All l^s, S3: Random start with K 
S4: Constrictive method with K = 9, 

S5« Epsilon method with value of the parameter = 0,2 
Nlunber of problems solved for each n = 27 
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Table 4.2.7 


C<~mputatinnal results fnr branch and bound and 
heuristic BEST LI CAL 

inly ‘'n diagonal elements of Q are negative . 
Value of I ; 1 

Density of matrix Q s li'f percent 


i'Jumber 

of problems 

solved for each case = 

2 

Number of 
variables 
n 

Average run 

Branch and 
bound 

time in sec. 

BEST LOCAL 

Average 

percent 

error 

D 

20 

0.08900 

0.0580 

0.00 

0 

40 

0.4690 

0.2590 

1.43 

1 

60 

1.3570 

0.5710 

0.24 

1 

80 

4.0790 

1.0240 

6.13 

2 

100 

7.9750 

1.5390 

4.13 

2 

120 

16.7470 

2.2190 

3.61 

2 

140 

33.6890 

3.0830 

6, 54 

2 

ii:>o 

37.4210 

3.5590 

4.87 

2 

160 

47.9600 

3.7230 

6.17 

2 

170 

62.1320 

4.1230 

8.23 

2 


D s Number of problems, for -which heuristic 
has not given optimal solution. 
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Table 4.2.12 

Computational results for quadratic set partitioning 

problems 

Density of matrix Q = 100 percent 

Percentage of negative elements = 0 
Value of I « 1 

Density of constraints* matrix A « 50 percent 


KftMber of 
constraints 

Average 

n = 50 

run time in sec. 

n = 75 

10 

1.772 

7.879 

20 

1.521 

6.831 

30 

1.412 

5.674 

40 

1.248 

4.532 
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Quf^dratic Set Po.rtitionjni'^ Problems? 

'./c s 'Ive scirae quadratic set partitioning problems 
usiiig proposed branch und bound .algorithm. The problems are 
first converted to equivalent unconstrained bivalent qua- 
dratic progrnr.Tming problems usiiig Hammer and Rudoanu's [7] 
result , 

For computational study, problems of size n = 50 and 
75, v;ith density of Q equal to KX percent, value of I 
cqu.'.l to 1, and percentage of negative elements equal to 0 
r.ro considered. The constraints' matrix A is generated 
using unifonnly distributed numbers and the density of 
matrix A is fixed at 50 percent. Problems are solved for 
different number of constraints as (lO, 20, 30, 40). 

Results r.ro reported in Table (4.2.12). It is obser- 
ve I th'-t tl:e computational time is decreasing with increase 
in number of constraints. Further, v/e have been able to 
solve problems with 75 variables and 10 constraints within 
7.87 sees. 

4,3 Conclusions s 

We considered quadratic bivalent programming problem 
with linc.ar constraints. Using Hammer and Rudeanu's [7] 
result, it is shown that the problem can be converted to 
oquival(?nt unconstrained quadratic bivalent programming 
prf.'blom. 
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Wo have dovelc-pod aii i;lgorithrn LOCi\L to find locally 
minini^ing point. Different starting point strategies and, 
rules for selecting variable in algorithm LOCAL are considered. 
Computational study is performed to identify the best start- 
ini'" point strategy and rule for selecting variable in algo- 
rithr. LOC^VL. It is observed that the selection rule that 
selects the highest negative element of C^DIAG dominates 
ether rules. Also for starting point strategy, it is found 
that generating K (prefixed)random start points with varying 
cariinality of I’s (prefixed) is the best strategy. 

Based on the above observations we suggest the 
following heuristic (BEST LOC/iL) for getting a good local 
solution, i) Select K random start points with cardinality 
of I’s being prefixed, ii) For each of the starting point 
ret local solution usi.ig algorithm LOGj^L. iii) Select the 
best local sc'lution. 

Fi.'r gl tbal minimization, a branch and bound algorithm 
is developed for which the initial incumbent is made equal 
t*. the c-boective function value from heuristic BEST LOCAL. 
Effective bounds are developed for pruning. In addition, 
Gulati'n [5] pruning test is also used for pruning. 

Computati ms are performed, for both branch and bound 
and heuristic BEST LOC^UL,, on two types of problemss l) The 
problems with only on-diagonal elements of Q negative, 

CENTRAL library 

I, /. T., Kanp'Jr. _ 
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2) The problons with negative elements distributed throughout 
Q. The clTcct of different parameters namely, ’i) Density of 
matrix Q, ii) I s Ratio of size of on diagonal to off- 
diag,.:nal elements of Q, iii) Percentage of negative elements 
in ta'tal nen-zero elements cf Q, on the performance of the 
br.'.ncr- and bound, heuristic BEST LOCilL is studied, 

licuristic BEST LOCji is c:jnpared with branch and 
b.'und algorithm in terms of computational time and average 
percentage of error, for different types of problems and 
different combinations cf the parameters. It is observed 
that the average computational time required for heuristic 
BEST LtX/iL is approximately same for given n, irrespective 
of values of other parameters* Also average percentage of 
i.-rror for the heuristic BEST LOC.’iL is varying from 0 to 2.81. 

Computational performance of branch and bound algori- 
thm is encouraging. We have been successful in solving 
problems with 170 variables, (only on diagonal elonents of Q 
bcinr negative, density of Q equal to 100 percent and 
value of I equal to l) .within 62 seconds of computational 
time. Earlier Gulati [5] has reported solving 125 variable 
problem within 198 seconds on same computer. 

Wo further observe that for computational purpose 
following’- problems are difficult to solve and can be used as 
test problems for the future studies. 
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1. Density cf Q = 100 percent, ratio of on diagonal 
to off diagonal elenicnts' size = 1, percentage of negative 
elements = 50, negative elements distributed throughout Q. 

For problems with only on diagonal elements negative, 
density of Q = 100 percent, ratio of size of on diagonal 
clrmonts to the off diagonal elements (density x no. of 
V iriablcs) . 

Further, we have been able to solve quadratic set 
partitioning problems with 75 variables and 10 constraints 
(density 50 percent of the constraint matrix, 100 percent Q, 
1=1) within 7.87 seconds. ¥e also observed that as the 
number of constraints in the set partitioning^ problem increases, 
the time to solve the problem decreases. 


A description of the computer program is given 


in Appendix I 
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.\PPLI'DIX I 


DESCRIPTION OF MODULES FOR BR^UvICK AND BOUI'lD 
AND HEURISTIC BEST LOCAL 


Tho linl^nf'^s of different modules are shown below-- 



E' 's crii.^tiori of the Mo» lules^ 

1. MJN: This is the main program, from which we call 
other programs depending on our requirements. 
Wc give format free input to the program as given 

boluwt 

Card 1: Plumber of variables, Code 1, Code 2, K . 

where Code 1 = 1 if exact solution is required 

else 0 

Code 2 = 1 if the constraints are present 


else 0 






1-2 


K « K\inbGr of starting points to be 
used in heuristic BEST LOC.iL. 

Card 2 onwards: Punch elements of matrix Q row wise. 

Then punch elements of constraints' 
matrix A row wise and finally the 
elements of vector b. 

The output will be as given below 5 

Ox'itininl objective function value and a vector contain- 
ing 0 and I's denoting optimal solution X. 

Subroutines called: UNCON, TR;j\f, TRIVAL, Pi^iSST, STIblN, 

LOFIND. 


2. UAiDbs Tills is the program for branch and bound algorithm. 

Subroutines called: PTEST, BTEST, ODIAGN, LOCVER. 


3* This is the program for heuristic BEST LOCiUl.. 

Subroutines calleil: LOFIIC>, (2DIAGN. 

4, LOFIIvDs This is the program for algorithm LOCfi. 


Subroutines called: QDIAGN. 

5 . QDI.iGN: This is used for finding; the values of QDIAG (X^) 

from QDIAG (X). 

6. LOCVER; This is used to verify/, whether a particular node 

is type I or II. 

7. PASSTt This calculates the sum of positive and negative 

elements of rows of Q, for different levels of 
fixing of variables. 



1-3 


8. PTESTs 

9. BTEST; 

10. TftlV.iLJ 

11. TRAN! 


12. UNCONs 


This is the program for pruning test. 

This is the program for bounding test. 

This is the program for trivial test. 

This program rearranges the elements of Q in 
ascending order of the sums of negative 
elements of rows of 0. 

This program converts the constrained quadratic 
bivalent programing problem to equivalent 
unconstrained bivalent quadratic programing 
problem. 


* AJfC 
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